Combining Visual and Textual Representations for Flexible Interactive Audio Signal Processing
نویسنده
چکیده
Interactive computer music systems pose new challenges for audio software design. In particular, there is a need for flexible run-time reconfiguration for interactive signal processing. A new version of Aura offers a graphical editor for building fixed graphs of unit generators. These graphs, called instruments, can then be instantiated, patched, and reconfigured freely at run time. This approach combines visual programming with traditional text-based programming, resulting in a structured programming model that is easy to use, is fast in execution, and offers low audio latency through fast instantiation time. The graphical editor has a novel type resolution system and automatically generates graphical interfaces for instrument testing.
منابع مشابه
SonART: A framework for data sonification, visualization and networked multimedia applications
SonART is a flexible, multi-purpose multimedia environment that allows for networked collaborative interaction with applications for art, science and industry. In this paper we describe the integration of image and audio that SonART enables. An arbitrary number of layered canvases, each with independent control of opacity, RGB values, etc., can transmit or receive data using Open Sound Control....
متن کاملInstruction Set Architecture for Multimedia Signal Processing
Multimedia signal processing, or media processing [1], is the processing of digital multimedia information in a programmable processor. Digital multimedia information includes visual information like images, video, graphics and animation, audio information like voice and music, and textual information like keyboard text and handwriting. With general-purpose computers processing more multimedia ...
متن کاملData-Driven Live Coding with DataToMusic API
Creating interactive audio applications for web browsers often involves challenges such as time synchronization between non-audio and audio events within thread constraints and format-dependent mapping of data to synthesis parameters. In this paper, we describe a unique approach for these issues with a data-driven symbolic music application programming interface (API) for rapid and interactive ...
متن کاملDesigning a Flexible Workflow for Complex Real-Time Interactive Performances
This paper presents the design of a Max/MSP flexible workflow framework built for complex real-time interactive performances. This system was developed for Emovere, an interdisciplinary piece for dance, biosignals, sound and visuals, yet it was conceived to accommodate interactive performances of different nature and of heterogeneous technical requirements, which we believe to represent a commo...
متن کاملMustajuuri – an Application and Toolkit for Interactive Audio Processing
Mustajuuri is a freeware application and toolkit for audio signal processing. It is designed for quick prototyping, testing and combination of audio or MIDI processing modules. Its main focus is on efficient and low-latency real-time operation. Mustajuuri offers an extremely flexible plugin architecture. By creating new plugins programmmers can extend Mustajuuri to meet new needs. The C++ API t...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2004